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(54) System and method for packet network trunking 



(57) Concurrent calls are multiplexed over packet 
network connections such as TCP/UDP/I P connections. 
Initially, semi-permanent, open channels (e.g., TCP 
and/or UDP channels) are established between two or 
more packet switches. The switches format incoming 
calls, as necessary, and multiplex them onto the open 



channels. Identifiers may be added to the multiplexed 
calls to facilitate the demultiplexing of the calls by the 
receiving switch. The multiplexed calls are encapsulat- 
ed into packet network protocol packets (e.g., TCP/IP 
or UDP/IP) for routing over a packet -based network (e. 
g., IP). 
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Description 

FIELD OF THE INVENTION 

[0001] The present invention relates to the routing of 
packet data over a network and, more specifically, to a 
system and method for multiplexing multiple calls onto 
a single or a few channels on a Packet Network. 

BACKGROUND OF THE INVENTION 

[0002] Packet data networks transfer packet data be- 
tween computers, IP telephones, video devices, com- 
puter telephony interface servers and other equipment. 
In a packet network, the stream of data from a data 
source is divided into variable or fixed length "packets" 
of data before it is sent over the network. The packets 
are then reassembled at the destination to regenerate 
the stream of data. Typically, the techniques of packetiz- 
ing data may make more efficient use of the data trans- 
mission facilities than methods (e.g. real time applica- 
tions) that use dedicated connections between each 
source and destination (e.g., conventional telephone 
switching systems). 

[0003] To enable the network to route the packet data 
to the appropriate destination, information (referred to 
as a header) is added to the data for each packet. A 
typical header contains the address of the source, the 
address of the destination and more information on the 
content of the packet. 

[0004] A header may include information for setting 
up the connection between the endpoints and it may in- 
clude information used to determine whether the con- 
nection has failed. In addition, information that is used 
to ensure that the data was sent without any errors may 
also be imbedded in the header. In practice, the format 
of the packet header and other packet routing details 
are defined by a protocol. 

[0005] One of the more popular packet network pro- 
tocols is the TCP/IP (Transmission Control Protocol / In- 
ternet Protocol) suite of protocols. The Internet Protocol 
("IP") relates to the data networking functions of routing 
a packet through the network. IP defines aframe of data 
including an IP header and the associated data (the 
"payload"). The network forwards the packet based on 
the network address contained in the IP header. 
[0006] IP does not provide data flow control or error 
control. These functions are left to the Transmission 
Control Protocol ("TCP"). Thus, applications ensure the 
integrity of the data being sent over the network by send- 
ing TCP messages to one another. These messages are 
encapsulated in the IP messages which, as discussed 
above, are primarily used for routing the data to the 
proper destination in the network. 
[0007] Applications that can waive the rigorous flow 
and error control that TCP provides may instead use the 
User Datagram. Protocol ("UDP"). In general, UDP pro- 
vides simpler data transmission than TCP because 



there is not as much overhead associated with error 
control. Both TCP and UDP define a frame which in- 
cludes an associated header. 

[0008] A TCP/IP (or UDP/IP) frame thus consists of 
5 the IP header and its payload. The IP payload, in turn, 
consists of the TCP (or UDP) frame and its payload. The 
TCP (or UDP) payload consists of the data being trans- 
mitted. This data may include other protocol information 
(e.g., H.323 discussed below), depending on the appli- 
io cation. 

[0009] In a simple example of a TCP/I P-based appli- 
cation, two switches (e.g., gateways or routers), both of 
which are connected to the IP network, are connected 
to several terminals that are connected to another net- 

is work (typically a switched circuit network or a packet 
network). For real-time call applications the terminals (e. 
g., telephones, computers or video devices) sen:' and 
receive signals (e.g., voice or video signals or digi-o: da- 
ta) to and from the associated switch. As necessary, 

20 each switch converts the incoming (and outgoing) sig- 
nals to (and from) the TCP/IP format. 
[0010] To transfer data through the network, the 
switches first set up a connection. A connection may be 
established, for example, using a three-way handshake. 

2S Briefly, this operation involves the transmission of a se- 
ries of synchronization signals and sequence numbers 
between the switches, in the TCP vernacular, this oper- 
ation opens a TCP connection. The TCP connection is 
associated with a pair of TCP sockets, one for each of 

30 the two switches. Each socket consists of an IP address 
and a port. 

[0011] Once a TCP connection is open, the switches 
simultaneously monitor their respective TCP ports to 
perform any necessary TCP control operations. These 
3S operations would include, for example, flow control, er- 
ror detection and data retransmission, each of which is 
performed independently for each connection. 
[0012] When the number of calls to be exchanged be- 
tween the switches is large, the above setup and mon- 
40 itoring operations reduce the efficiency of the network 
and the switches. In particular, the switches need to 
open, maintain and close several connections per call. 
In addition the three-way handshake reduces the speed 
at which each connection may be set up. The monitoring 
45 operations and the memory allocation for each connec- 
tion use a significant amount of the resources of the 
switches. The overhead associated with the headers re- 
duces the data throughput. Also, the communications 
exchanged to open and close channels burden the net- 
so work and reduce the available bandwidth. Thus, a need 
exists to improve the efficiency of data transfers in a 
packet-based network. 

SUMMARY OF THE INVENTION 

55 

[0013] The invention provides a system and method 
for routing concurrent calls between switches connect- 
ed to a wire-based, wireless or satellite packet network 
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(e.g., a TCP/UDP/IP network). 

[0014] In one preferred embodiment of the present in- 
vention the packet network is: an internet protocol net- 
work, or over a heterogeneous mesh network, or over a 
lower level network that supports packet -based commu- 
nications including at least one of an ATM network, an 
Ethernet-based network and a FDDI network, or over a 
SCN that uses a packet transport protocol. 
[0015] The incoming calls to the switches (e.g., those 
originating from the terminals connected to each switch) 
are multiplexed onto a single TCP or UDP channel (or 
relatively few channels as discussed below). Thus, the 
multiplexed calls are treated as a single connection. As 
a result, the switches do not allocate and set up individ- 
ual TCP or UDP connections for each call. Instead, calls 
are established using a simplified connection setup pro- 
cedure. 

[0016] In one preferred embodiment of the present in- 
vention, at least one of the calls is one of a group includ- 
ing: an H.323 call, a voice over internet protocol call, a 
facsimile over internet protocol call, a telephone call, an 
H.324 call or an H.320 call. 

[0017] Prior to routing the calls, the switches set up a 
"permanently" open TCP connection (and UDP connec- 
tion, if necessary) between one another. This connec- 
tion, referred to as an IP trunk, is permanent in the sense 
that it is not set up and torn down on a call -by-call basis. 
Instead, in general, it is set up to make the connection 
available for use (for example, when the switch is pow- 
ered-up), irrespective of whether there is a call that pres- 
ently needs to be sent through the trunk. Similarly, the 
trunk is not necessarily torn down merely because no 
calls are presently using the connection. Rather, it typi- 
cally is torn down based on other considerations (for ex- 
ample, when the switch is powered-down). 
[0018] After the trunk connections (i.e., the perma- 
nent TCP and UDP connections) are opened, the data 
streams from the incoming calls are multiplexed onto the 
connections according to the transport protocol type. 
Thus, multiple TCP data streams are multiplexed onto 
the permanent TCP connection. Multiple UDP data 
streams are multiplexed onto the permanent UDP con- 
nection. 

[0019] In one embodiment, when a call is made to a 
switch, the switch adds a header to the call data. The 
header includes, for example, relatively simple two-way 
call setup information and an identifier. The switch on 
the receiving end uses the identifier to demultiplex the 
incoming data on the trunk into the individual streams 
of data for each of the calls. 

[0020] In another embodiment, the switches provide 
multiple IP trunks to handle the call traffic. Yet, typically, 
the number of trunks is significantly smaller than the 
number of calls. As above, the switches do not perform 
TCP/UDP call setup and monitoring for each call. In- 
stead, each call is multiplexed onto one of the trunks 
using simplified call setup procedures. The calls are 
multiplexed according to selected call distribution crite- 



ria. 

[0021] The invention thus provides a way to achieve 
more efficient data transfer and to use the resources of 
the switches and the network more efficiently. The sim- 

s plified call setup procedure for each call reduces the call 
setup time. The routing of multiple calls through a single 
trunk (or relatively few trunks) results in less overhead 
being required for each call, thereby reducing network 
traffic and bandwidth requirements. Moreover, the 

io switches do not monitor each individual call. Rather, 
they only monitor the trunks (i.e., the permanent TCP 
and UDP connections). Thus, a system constructed ac- 
cording to the invention may use the processing re- 
sources of the switches more efficiently in comparison 

is to many conventional systems. 

BRIEF DESCRIPTION OF THE DRAWI NGS 

[0022] These and other features of the invention will 
20 become apparent from the following description and 
claims, when taken with the accompanying drawings, 
wherein similar references characters refer to similar el- 
ements throughout and in which: 

25 FIGURE 1 is a block diagram of one embodiment 
of a data communications network employing call 
multiplexing according to the invention; 
FIGURES 2A and 2B are a block diagram illustrat- 
ing additional details for one embodiment of a 
30 switching system constructed according to the in- 
vention; 

FIGURES 3A and 3B are flowcharts illustrating IP 
trunking operations that may be performed by the 
system of FIGURE 2; 
35 FIGURE 4 is a graphical representation of a mes- 
sage structure used in the multiplexing operation of 
one embodiment of the invention; 
FIGURE 5 is a graphical representation of a modi- 
fied TCP/IP packet; 
40 FIGURES 6A and 6B are a block diagram of an em- 
bodiment of the invention that multiplexes calls over 
multiple connections; and 

FIGURE 7 is a block diagram of an exemplary con- 
figuration of a network employing the principles of 
45 the invention. 

DESCRIPTION OF EXEMPLARY EMBODIMENTS 

[0023] FIGURE 1 depicts a block diagram of a data 
50 communications network N that utilizes the call multi- 
plexing feature of the invention. A pair of switches (e.g., 
gateways), switch A 20A and switch B 20B, route data 
to each other over a packet network 24 (e.g., IP-based). 
Each switch is connected to several terminals 26 that 
55 send and receive analog or digital signal streams to and 
from their associated switch. An exemplary data flow in 
the network N involves sending information from termi- 
nal A 26A (left) to terminal B 26B (right). Switch A 20A 
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processes the signal stream from terminal A 26A and 
passes data packets to the network 24 The network 
routes the datato switch B 20B. Switch B 2°B processes 
the data, as necessary, and routes it to terminal B 26B. 
r00241 In accordance with one possible implementa- 
tion of the invention, each switch 20 multiplexes the .re- 
formation from its associated terminals onto a single 
TCP connection (i.e., the IP trunk). To this end, trunk 
connection managers 28 in each switch 20 cooperate 
to establish a permanent TCP connection between the 
switches via the network 24. This TCP connection is .n 
most respects a "normal" TCP connection except that <t 
is not set up and torn down with each call from the end- 
points (e.g., terminals 26). Instead, the connection re- 
mains open (typically passively open) as calls come and 

f002S] When a terminal (e.g., 26A) needs to set up a 
call to a terminal (e.g., 26B) on the remote end, a trans- 
mit message processor 32 in the associated switch (e. 
a 20A) encapsulates the call setup messages (e.g., 
OPEN) within TCP packets. In particular, the transmrt 
message processor 32 generates headers that contain 
call setup, message type and identifier information. 
These headers are then associated with the data pack- 
ets for each call. 

r0026] After the encapsulated messages are gener- 
ated, a packet multiplexer 30 in the switch A 20A multi- 
plexes the packets onto the TCP connection. The net- 
work 24 routes the TCP messages to the switch at the 
remote end (e.g., switch B 20B). A packet demultiplexer 
34 in switch B 20B reads the identifier information im- 
bedded in the header to demultiplex the data associated 

with each call. A receive message processor 36 reads 
the header information for each call and performs the 
appropriate operations. The receive message proces- 
sor 36 then strips the header related to the trunk from 
the packet and routes the packet to the endpo.nt (e.g., 
terminal 26B) designated for the call. 
r00271 With the above high-level description in mind, 
exemplary structures and operations ^f the invention 
are treated in more detail in FIGURES 2A, 2B, 3A and 
3B FIGURES 2A and 2B (referred to hereafter as FIG- 
URE 2) depict an embodiment of a data communica- 
tions system S that supports the ITU-T (the telecommu- 
nications standardization section of the Internal jional 
Telecommunications Union) standard H.323. FIGURES 
3A and 3B illustrate IP trunking operations performed 
bv the embodiment of FIGURE 2. 
[O02S1 Referring to FIGURE 2, calls from several ter- 
minals are routed to remote terminals via a pair of 
switches 40 (e.g., gateways) that are connected via an 
internet or Intranet data network 90. The system S sup- 
ports terminals running several different protocol stand- 
ards. For example, the telephones may support the In- 
tegrated Services Digital Network ("ISDN") protocol (tel- 
ephone A 42A), the telephones may be standard analog 
sets (telephone 44A) or they may support some other 
protocols (e.g.. CORRNET by Siemens). The data ter- 



minals may be protocol-based, ej , H-^H.324 and 
H 320 Those depicted are H.323 terminals 48, H.320 
terminal 117 and H.324 terminal 119. The H.323 proto- 
col discussed in more detail below. 
s r0029] in accordance with the present mention, the 
switches 40 perform IP trunking. Thus, the swrtches 40 
multiplex the calls from the terminals onto an^ P MWnfc 
The basic multiplexing operation performed by the 
switches is the same as discussed ab eve in junction 
io with the embodiment of FIGURE 1. n adcttcn. FIGURE 
2 explicitly illustrates the previously mentioned H.323 
and UDP components. 

r0030] The H.323protocol is the ITU-T protocol stand- 
ard for multimedia conferencing over packet switched 
is networks, specifically, voice, data, video and 

over I P H.323 defines the protocols to be used tor these 
various types of information (e.g., G.711 for audio. H. 
26i for video) and other signaling and control functions. 
The H 323 standards, including specifications for H. 
zo 323-based terminate, gateways, etc may be - tound m 
the documents: ITU-T Recommendation H.323, Visual 
Telephone Systems and Equipment for Local Area Net- 
works Which Provide a Non-Guaranteed^ Quality of 
Service" 1996; H.323 version 2: "Packet Based Multi- 
2S media Communication Systems", ITU-T 1998 (to be 
published), the contents of both of which are inporporat- 
ed herein by reference. 

m 03 1] Referring*, FIGURES 3Aand 3B, the IP • ttunk- 
ng operation performed by the system of FIGURE 2 w, 
so be discussed in more detail. Specifically, beginning at 
block 200 FIGURES 3A and 3B describe exemplary IP 
trunk setup, call setup and message ^ 
ations for the switch that originates a call and the switch 
that receives the call, respectively. 
as r0032] At block 202, a trunk connection manage r 23 
FIGURE 2B) in one of the -switches (e.g., swrtch A40A) 
nitiates connection procedures for a TCP-based IP 
EX 80 and a UDP-based IP trunk 82. The TCP con- 
nection setup is done in a standard way, e.g., rt uses a 
40 three-way handshake. Following UDP Protocol the 
trunk connection manager 28 also cooperate to open, 
the UDP-based IP trunk 82. 

r0033] After the connection establishment procedure 
Is completed for the trunks, the switches perform the 
45 normal call maintenance operations for open TCP and 
UDP connections. The details of the TCP/UDP/IP pro- 
tocols are well known in the data communications art. 
For example, detailed descriptions of exemplary .mple- 
mentations and related structures may be found in the 

so interne kjn g Wjth TCP/IP: Pnnciples, Prog 

colsand Architecture, Douglas E. Comer, Prentise Hall, 
1996 ISBN - 0132169878, the contents of which is in- 
corporated herein by reference. Accordingly, those as- 
pects of the embodiments described herein will not be 
ss discussed further. 

r00341 At block 204, the switches 40 "wart" for the next 
task that needs to be performed. In practice, task initia- 
tion could be implemented in a variety of ways including 
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polling, interrupts, task scheduling, etc. Three tasks are 
of particular relevance here: (1 ) a message has been 
received from an endpoint (e.g., terminal A 48A); (2) a 
TCP or UDP packet is ready to be sent over an IP trunk; 
or (3) a permanent connection is to be terminated. 
[0035] If a message has been received, the process 
proceeds to block 206. At this point, the process deter- 
mines whether the message relates to a new call or 
channel. For example, if terminal A 48A (FIGURE 2, low- 
er left) has sent an H.323 SETUP message to SWITCH 
A 40A to establish a call with terminal B 48B (lower 
right), the process proceeds to block 208 and generates 
the appropriate identifiers (discussed below). If this was 
not a new call, the switch retrieves the previously de- 
fined identifiers associated with the incoming message 
process (block 210). 

[0036] At block 212, a message processor 84 gener- 
ates a header to be appended to the H.323 data. Typical 
headers are depicted in the messages shown in FIG- 
URE 4. (FIGURE 4 depicts an exemplary sequence of 
messages sent between switch A and switch B over the 
IP trunk. These messages will be referred to throughout 
this specification.) The message header 50 typically in- 
cludes basic call setup and flow control information. The 
rest of the message consists of the original H.323 packet 
from the endpoint. 

[0037] MESSAGE 1 in FIGURE 4 is an example of a 
message that could be sent to set up an H.323 call. The 
first field 52 in the header contains the message status. 
Because this is the first message in the call, the mes- 
sage contains call setup information: "OPEN" indicates 
that this message is opening a new call process. In order 
to reduce the number of exchanged messages, the 
trunk message "OPEN" is associated with the call mes- 
sage "SETUP" (discussed below). 
[0038] The second field 54 contains an identifier. An 
identifier generator 86 (FIGURE 2A) assigns a unique 
identifier (the number "I" in this example) to each call 
(as discussed above in conjunction with block 208 in 
FIGURE 3A). In one embodiment, each message (from 
a given endpoint) that is associated with a particular call 
will contain the same identifier. For example, MESSAGE 
5 (an example of a message that could be used to open 
an H.245 channel for the call) contains the same iden- 
tifier (in field 54) as MESSAGE 1 . 
[0039] The next two fields typically contain other iden- 
tifiers that may be used in some embodiments. The third 
field 55 (source process identifier) contains an identifier 
that is assigned to an individual process at the source 
switch associated with a call. For example, in a typical 
call, several TCP and UDP connections are opened. In 
addition, other messages associated with signaling and 
other processes may be sent during the course of a call, 
in this case, there will be a unique identifier associated 
with each process even though they are all associated 
with the same call. 

[0040] The identifier generator 86 (FIGURE 2A) as- 
signs the identifier (the number °4 n in this example) to 



each process (block 208, FIGURE 3A). Each message 
(from a given endpoint) that is associated with a partic- 
ular process will contain the same identifier. For exam- 
ple, MESSAGE 8 (an example of a message that could 
s be used to close the call, again, the trunk message 
"CLOSE" is associated with the call message "RE- 
LEASE COMPLETE") contains the same source proc- 
ess identifier as MESSAGE 1 . 

[0041] It will be appreciated that the identifiers may 
to be implemented in a variety of ways. For example, in 
some applications it may be desirable to use only one 
of the above types of identifiers. Also, identifiers could 
be associated with messages in ways other than on a 
per call or per process basis. In addition, certain com- 
ts . mands have fields within which identifiers may be sent. 
For example, as depicted in FIGURE 4, H.323 SETUP 
and CONNECT messages have a call identifier field 
(CID 59) and a call reference value field (CRV61). Sim- 
ilar fields exist in H.323 Registration Admission Status 
20 ("RAS") messages. These and other fields may be used 
to pass identifiers in accordance with the present inven- 
tion. 

[0042] The fourth field 56 (destination process identi- 
fier) typically contains the identifier assigned to the proe- 
ms ess by the remote switch. However, during call setup, 
this field may be used to identify the H.323 message 
type. The designation 0 IP-Q931 n signifies that MES- 
SAGE 1 is a Q.931 call signaling message. Thus, it may 
contain messages of the types: SETUP, CONNECT, 
30 ALERTING, CALL PROCEEDING, etc. 

[0043] The remaining fields contain the H.323 proto- 
col message sent by terminal A 48A. The fifth field 58 
contains the H.323 command. In this case, the H.323/Q. 
931 SETUP message sent by terminal A. The original 
3S H.323 packet data is embedded in the data (pay load) 
60 portion of MESSAGE 1 . Significantly, it may be seen 
that the system can pass data beginning with the first 
message of the original call. 

[0044] Referring again to FIGURE 3A, at block 214 

40 the multiplexer 30 (FIGURE 2A) multiplexes the encap- 
sulated message. (e.g., MESSAGE 1 ) with other encap- 
sulated messages (assuming that there are other calls 
currently being routed through the IP trunk). 
[0045] At block 21 6, if the outgoing message is termi- 

45 nating a call or process (e.g., as in MESSAGE 9 in FIG- 
URE 4 : the status is "CLOSE ACK"), an appropriate 
message is sent to the message processor. 84. The 
message processor 84 then clears or reallocates the 
identifier (call or process) so that it may be used for an- 

50 other call or process (block 218). 

[0046] The message processing operation then re- 
turns to block 204. If at block 204 a packet is ready to 
be sent over the IP trunk, the process proceeds to block 
220. Assuming that this is a TCP channel, a TCP/IP for- 

55 matter 88 (FIGURE 2B) encapsulates the packets into 
a TCP/IP packet. (It the channel was UDP, for example, 
H.323 voice, a UDP/IP formatter 100 encapsulates the 
packets into a UDP/IP packet.) An exemplary TCP/IP 



5 



vJSDCCID: <EP 092321 1A2J_> 



9 



EP 0 923 211 A2 



10 



packet with an IP header 62 and a TCP header 64 is 
depicted in FIGURE 5. In this example, the encapsulat- 
ed packets are embedded in the TCP payload 66. 
[0047] Referring again to FIGURES 2B and 3A, 
switch A 40A sends the TCP/IP (or UDP/IP) packet that 
includes MESSAGE 1 to switch B 40B over the TCP- 
based IP trunk 80 (or UDP-based IP trunk 82) estab- 
lished through the network 90 (block 222). In practice, 
the trunk may use H.323 call procedures or call proce- 
dures for other TCP/UDP/IP-based protocols. The call 
processing procedure again returns to block 204. 
[0048] Summarizing, switch A has now trunked call 1 , 
opened a Q.931 TCP port associated with source proc- 
ess identifier 4 and sent the SETUP message. 
[0049] Referring now to FIGURE 3B, exemplary call 
processing operations for the switch that receives the 
call (e.g., switch B 40B) are treated beginning at block 
250. To reduce the complexity of FIGURE 2, the details 
of switch B 40B, which are the same as the details of 
switch A 40A, are not shown. As above, at block 252 
switch B sets up the IP trunk(s). Then, at block 254, 
switch B 40B "waits" for a task: (1 ) a message has been 
received over the IP trunk; or (2) a permanent connec- 
tion is to be terminated. 

[0050] When switch B 40B receives a TCP/IP (or 
UDP/IP) packet, the process proceeds to block 256. A 
TCP/IP lormatter 88 (or UDP/IP formatter 1 00) process- 
es the incoming packet 

[0051] At blocks 25B through 262, a demultiplexer 34 
demultiplexes the encapsulated packets (e.g., MES- 
SAGE 1). Preliminarily, the message header is read to 
determine whether a new process needs to be opened 
to handle the message (e.g., does the status field 52 
contain "OPEN"). If so, appropriate processing is per- 
formed at block 260 to handle the message (e.g., read- 
ing the destination process identifier to determine the 
message type; initiating corresponding processes). 
[0052] At block 262, the demultiplexer 34 routes the 
calls based on the received identifier (e.g., the identifier 
54 and/or the source process identifier 55). To this end, 
an identifier mapper 92 compares the incoming identifier 
with the identifier entries in an identifier table 93 (FIG- 
URE 2A) that map each identifier with, for example, a 
specific call or process. 

[0053] Next, the message processor 84 sends the 
message to the appropriate endpoint (block 263). Con- 
tinuing with the above example, switch B 40B thus 
sends the H.323 SETUP message to terminal B 48B. 
[0054] At block 264, if the incoming message is ter- 
minating a call or process (e.g., status is "CLOSE 
ACK"), an appropriate message is sent to the message 
processor 84. The message processor 84 then clears 
or reallocates the identifier (call or process) so that it 
may be used for another call or process (block 266). For 
example, the identifier mapper 92 may remove the entry 
for that identifier from the identifier table 93. The call 
processing operation then returns to block 254 to proc- 
ess the next incoming message. 



[0055] To complete the explanation of the call setup 
procedure, a brief description of the response from ter- 
minal B to the H.323 SETUP message follows. Per 
standard H.323 procedures, terminal B 48B sends a 

s CONNECT message to switch B 40B. Switch B per- 
forms similar message processing on the H.323 mes- 
sage from terminal B as was performed by switch A on 
the message from terminal A 48A. 
[0056] For example, switch B may generate a mes- 

io sage having the form of MESSAGE 2 in FIGURE 4. The 
first field 68 in the header contains the status "OPEN 
ACK" indicating that this message is acknowledging an 
"OPEN" message. The second field 70 contains an 
identifier (number "1 " indicating that this message is as- 

15 sociated with the same call with which MESSAGE 1 is 
associated). 

[0057] In the third field 71 , the number " 17" is the iden- 
tifier assigned by switch B to this Q.931 channel proc- 
ess. The fourth field 72 contains the identifier (number 

20 -4°) assigned to this call by the other switch (40A). This 
is used by the other switch to associate this message 
with the correct call of the proper endpoint (i.e., terminal 
A). MESSAGES 1 and 2 illustrate that the switches as- 
sociated with each endpoint may assign different iden- 

2S tifiers to the messages associated with a given call and 
a given channel. 

[0058] The fifth field 74 contains the H. 323 message, 
namely, the H.323/Q.931 CONNECT message sent by 
terminal B 48B. In the same manner as described for 
30 MESSAGE 1, the original H.323 message (or com- 
mand) is embedded in the payload portion (fields 74 and 
76) of MESSAGE 2. 

[0059] The message is encapsulated in a TCP/IP 
packet that is sent to switch A 40A. Summarizing again, 
35 switch B 40B has now acknowledged call 1, opened a 
Q.931 port associated with its source process identifier 
17, acknowledged the Q.931 port associated with 
source process identifier 4 of switch A, and sent the 
CONNECT message received from terminal B. 
40 [0060] Switch A 40A processes the packet as dis- 
cussed above, and sends the CONNECT message to 
terminal A 48A. At this point, the call is established and 
the terminals can send other messages for this call. 
[0061] MESSAGES 5 and 6 are examples of messag- 
es es for call 1 that may be sent over the IP trunk at some 
later point in time. MESSAGE 5 is used to open the first 
H.245 channel for call 1 . Switch A 40A opens a process 
with associated source process identifier "8" and sends 
a master-slave determination message. Per MESSAGE 
50 6, switch B 40B acknowledges the H.245 open, opens 
its process (identifier 200), acknowledges the process 
(identifier 8) for switch A, and acknowledges the master- 
slave determination message. 

[0062] The messages for a call are transferred in a 
55 similar manner as described above until the call is torn 
down. MESSAGES 8 and 9 illustrate an exemplary call 
termination procedure for call 1 . Terminal A48A initiates 
the procedure by sending an H.323 "RELEASE COM- 
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PLETE" message to terminal B 48B over the Q.931 
channel for call 1 . Switch A 40A appends the "CLOSE" 
status and the identifiers corresponding to those of the 
Q.931 open messages and sends the message to 
switch B 40Bi which relays the H.323 message to termi- 
nal B48B. Terminal B responds by sending a ■DISCON- 
NECT" message. Switch B appends the "CLOSE ACK" 
status and the identifiers and sends the message to 
switch A. Switch A 40A relays the "DISCONNECT" to 
terminal A 48A. 

[0063] Once the "CLOSE ACK" has been received by 
switch A 40 A, the identifiers (e.g., 4 and 17) are free to 
be used for other calls and processes. Thus, the identi- 
fiers are reallocated as discussed above in conjunction 
with blocks 216 and 218 ol FIGURE 3A and blocks 264 
and 266 of FIGURE 3B. 

[0064] At some point in time, the IP trunk may need : 
to be torn down (i.e., the permanent TCP and UDP con- 
nections disconnected). Either switch can initiate tear- 
ing down the IP trunk as depicted in FIGURE 3Aat block 
224 and FIGURE 3B at block 268. The details of basic. 
TCP/UDP call disconnect procedures are also well 
known in the art as mentioned in the references cited 
above. The IP trun king operations for FIGURES 3Aand 
3B thus terminate at blocks 226 and 270, respectively. 
[0065] As depicted in FIGURE 4, a system construct- 
ed according to the invention multiplexes a variety of call 
types originating from a variety of endpoints onto the IP 
trunk. MESSAGE 3, for example, may be for a call (call . 
2) from terminal D 48D to terminal C 48C. Switch B 40B 
opens the Q.931 port (source process identifier 44) and 
the SETUP message is relayed through switch A 40A 
to terminal C 48C. Terminal C 48C sends a Q.931 
"ALERTING" message to acknowledge call 2. Switch A 
40A opens a Q.931 process (identifier 100), acknowl- • 
edges the Q.931 process for call 2 on switch B 40B, and 
sends the H.323 "ALERTING" message. It will be un- 
derstood that a wide variety of message types can be 
sent over the trunk. For example, H.323 has many dif- 
ferent channels, e.g., Q.931 (TCP) and RAS (UDP). 
[0066] Multiplexing according to the invention is fur- 
ther illustrated by the multiplexed data 66 in FIGURE 5. 
In this example, MESSAGES 1, 4 and 7 (from FIGURE 
4) are multiplexed into a single packet. MESSAGES 1 
and 4 were discussed above. MESSAGE 7 is a message 
for an existing call (status = "PROGRESS") designated 
as call 5. Ports on the two switches have been allocated 
and confirmed to support an H.245 channel for the call. 
The H.323 message being sent is an example of a con- 
trol message for data encryption. 

[0067] It will be understood that the sequence depict- 
ed for the messages in FIGURE 4 is merely illustrative. 
In practice, MESSAGE 2 will be sent some time later 
than MESSAGE 1 and will travel the opposite direction 
over the IP trunk. The same relationship exists between 
MESSAGES 3 and 4 and between MESSAGES 5 and 
6. MESSAGE 7 is unrelated to any other message 
shown. MESSAGES 8 and 9 will be sent some time after 



MESSAGES 1 and 2. 

[0068] The call procedures for voice and video con- 
nections are similar in most respects to those discussed 
above. For example, when telephone A 42A (or video 

5 device A 46A) initiates a call to telephone B 42B (or vid- 
eo device B 46B), a protocol converter 94 converts the 
voice signals (video signals) received over line 96 (or 
line 98) to H.323 packets or another protocol, e.g., H. 
324 or a proprietary protocol. The details of these con- 

io version processes are well known in the data commu- 
nications art. Once the data is in the H.323 format, the 
operations are essentially the same as those described 
above for the H.323 data connection. Thus, switch A 
40A multiplexes these H.323 packets with the other H. 

is 323 packets (e.g., the packets from the data terminals). 
When the packets are received by switch B 40B, an H. 
323 protocol converter in switch B 40B converts the H. 
323 packets back to telephone (or video) signals. 
[0069] In practice, the telephone and video streams 

20 typically will be routed over a UDP-based IP trunk 82 
rather than a TCP-based IP trunk 80, while the call sig- 
naling and control are routed over TCP. As discussed 
above, information transmissions that do not require the 
high reliability of a TCP connection may be routed over 

25 a UDP connection. The H.323 standard specifies that 
video and audio are routed over UDP. Thus, in FIGURE 
2, the switch will multiplex the calls from the telephones 
and video terminals over the UDP-based IP trunk 82. 
[0070] The UDP-based IP trunk multiplexing opera- 

30 tion is related to the TCP-based IP trunk multiplexing 
operation. For example, the multiplexing operations are 
similar and the same encapsulation techniques may be 
used. Thus, the switch may generate messaging and 
identifier information as previously discussed. In addi- 

35 tion, the encapsulated packets may be sent in the UDP 
payload while some trunk information can be sent via 
the options portion of the UDP header. 
[0071] Design considerations related to voice and fac- 
simile transmission over IP may be found in the text Un- 

40 derstandina the Voice Enabled Internet, Ed Marguiies, 
Flatiron Publishers Inc., 1996, ISBN-0-936648-91-0and 
on the World Wide Web at pulver.com. 
[0072] Referring now to FIGURES 6A and 6B (re- 
ferred to hereafter as FIGURE 6), an alternate embod- 

45 iment of the invention employing multiple IP trunks is 
described. In FIGURE 6, connections between two sets 
of terminals 26 are established via a pair of gateways 
104 connected to an Internet 24. Telephone calls from 
several of the terminals 26 are also routed through a 

so Private Branch Exchange ("PBX") 106. The gateways 
104 are configured to perform the TCPAJ DP/IP trun king 
operation discussed above with the additional feature 
that multiple trunks are provided. 

[0073] As above, the system of this embodiment sup- 
ss ports terminals running several different protocol stand- 
ards. For example, the telephones may support the In- 
tegrated Services Digital Network ("ISDN") protocol, 
they may be standard analog sets or they may support 
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some other protocol (not shown). Again, as described 
above, the data terminals may be protocol-based. 
Those depicted are IP terminals and H.323 terminals. 
[0074] The system of FIGURE 6 also illustrates that 
the gateways may trunk data from another IP network 
105. In particular, packets from a facsimile over IP de- 
vice 107 may be multiplexed over the IP trunk. 
[0075] The PBX 106 handles call routing and call dis- 
tribution for the telephone terminals. The lines (116A 
and 116B) from the PBX 106 to the gateway 104 typi- 
cally support the same protocols as the telephones (i. 
e., ISDN, analog, etc.), however, they typically are mul- 
tiplexed, high data rate channels. 
[0076] A gateway may be a standard component in 
H.246 (related to H.323). Conventionally, a gateway 
routes data from a Switched Circuit Network ("SCN") to 
a Packet Network and vice versa. In general, the gate- 
way provides protocol conversion and other routing op- 
erations. In the embodiment of FIGURE 6, the gateway 
104 routes data between a TCP/IP-based Internet 24- 
and the Packet Networkfor the terminals (e.g., the LAN/ 
IP network 108 and the PBX 106) and an IP network 
105. Details of an H.323-based gateway may be found 
in the above- referenced ITU-T documents. 
[0077] In accordance with the present invention, the 
gateways are configured to multiplex the calls from the 
terminals onto a TCP-based IP trunk 110 or a UDP- 
based IP trunk 112. The multiplexing operation of the ' 
gateway 1 04 is similar to that of the embodiments of 
FIGURES 1 and 2 except that multiple trunks (11 0A- 
11 ON; 112A-112M) are provided. In addition, the gate- 
ways 1 04 are configured to provide H.323 protocol con- 
versions. For example, an H.323 protocol converter 94 
in the gateway (e.g., 1 04A) converts the telephone calls 
to H.323 packets. When the packets are received at the. 
remote gateway (e.g., 104B), an H.323 protocol con- 
verter 94 (not shown) converts the H.323 packets back 
to a telephone call. 

[0078] Turning now to the multiple trunk feature de- 
picted in FIGURE 6, instead of routing all calls (or proc- 
ess messages) over a single trunk, the system distrib- 
utes the incoming calls over several trunks. A message 
distributor 114 receives each incoming call (process 
message) and dispatches it to one of the trunks. 
[0079] A variety ol distribution schemes may be em- 
ployed, depending on the requirements of the system. 
For example, in a system that uses port cards where 
each card supports multiple ports, all of the calls (mes- 
sages) coming in on that card may be routed to the same 
trunk. Alternatively, the message distributor 114 may 
use a simple queue whereby all calls (messages) are 
sent to a given trunk (e.g., 11 OA) until the traffic on the 
trunk reaches a given threshold (e.g., 10calls : 100 mes- 
sages). Once the threshold is reached, the message 
distributor 114 routes the calls (messages) to another 
trunk (e.g. , 1 1 0N). In another embodiment, the message 
distributor 1 1 4 may route calls (messages) based on the 
level of service of the trunk. For example, some TCP/IP 



connections may guarantee high Quality of Service 
("QoS") or secure service. In this case, the message dis- 
tributor 114 may assign the calls (messages) to a trunk 
having the preferred level of service. This trunk assign- 
5 rnent may be based, for example, on predefined assign- 
ments or on messages associated with the calls (mes- 
sages). 

[0080] As in the embodiments above, the originating 
gateway (e.g., 104A) multiplexes all of the H.323 pack- 

io ets assigned to a given trunk onto that trunk. The mul- 
tiplexed packets are sent via the trunk to the remote 
gateway (e.g., 104B). Typically, a call (message) distri- 
bution scheme similar to the one described for the TCP- 
based IP trunks is implemented for the UDP-based IP 

is trunks. 

[0081] FIGURE 7 is a block diagram of an exemplary 
configuration that illustrates the flexibility of the inven- 
tion. Here routers and gateways that are distributed 
throughout a network establish multiple IP trunks be- 

20 tween one another. A router A 120 receives calls from 
other networks (e.g., network 124) and several termi- 
nals 122A, 122Band 122C (the calls from the H.320 ter- 
minal 1 22C are converted by a Video Interface Unit 1 32, 
for example, a a VlU-323 n unit manufactured by RADVi- 

2S sion). These calls are distributed over several IP trunks 
1 26A and 1 26B. One set of I P trunks 1 26 A is established 
between router A 120 and another router (router B) 128. 
Another set of IP trunks 126B is established between 
router A 120 and a gateway 130. A third set of trunks 

30 126C is established between router B 1 28 and the gate- 
way 130. As FIGURE 7 illustrates, IP trunking may be 
used in any part of the network where it is desirable to 
realize the advantages of the invention. 
[0082] FIGURE 7 also shows that the present inven- 
ts tion may be practiced over a wide variety of networks 
that support packet-based communications. For exam- 
ple the lower level network may be an Asynchronous 
Transfer Mode ("ATM") network, an Ethernet family of 
networks (e.g., 10Mbit, 100Mbit, 1Gbit or 10Gbit Ether- 

40 net), a token ring network or a Fiber Distributed Data 
Interface ("FDDI") network. The network may also be an 
SCN using a packet transport protocol such as SLIP, 
Point-to-Point Protocol ("PPP") or Multi-Level PPP 
("MLPPP"). Also, a satellite network may be used. Fi- 

45 nally, the network may be wire-based, wireless or a com- 
bination of the two (e.g., a heterogeneous mesh 134). 
[0083] In the embodiments described above, it would 
be understood by one skilled in the art that the endpoints 
for a given call need not be ol the same type. For exam- 

50 pie, a connection may be made from an H.323 terminal 
to a telephone via a gateway and a PBX. Many other 
configurations are possible using appropriate protocol 
conversions. Moreover, it would be apparent to one 
skilled in the art that the components of the illustrated 

55 embodiments and other related components may be 
combined in a variety of ways when implementing 
teachings of the invention. 

[0084] The invention thus provides an improved 
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method of routing calls over an IP network. The inven- 
tion is particularly advantageous in cases where two (or 
more) gateways, routers, PBXs, etc. are routing a rela- 
tively large number of concurrent calls between each 
other. As an example, two remotely located offices of 
the same corporation typically would have a large 
number of concurrent calls being made between each 
office throughout the day. According to the present in- 
vention, all of these calls could be routed over an IP net- 
work an Intranet or the Internet, in the efficient way that 
uses a reduced number of TCP or UDP channels. The 
invention also applies to one-way distribution of multiple 
audio or video streams (e.g., video on demand or broad- 
cast for World Wide Web and television applications). 
[0085] The invention provides a number of advantag- 
es over conventional systems including reduced call 
setup time, reduced call overhead and improved data 
throughput. Specifically, the three-way handshake used 
to open a TCP connection within each call and the finish/ 
finish acknowledgment used to end these TCP connec- 
tions are essentially eliminated. Instead, there can be 
just one global three-way handshake when the trunk 
channel is opened. Significantly data may be passed 
along with these* call setup messages. Similar advan- 
tages are obtained at the message tear down stage. The 
elimination of the above three-way handshake and the 
tear down messages per call will thus speed up the call 
setup procedure. 

[0086] Moreover, the invention reduces the resources 
expended by the gateways, etc., related to simultane- 
ously handling a large number of TCP and UDP ports. 
In particular, the gateway will expend less processing 
power handling the TCP stack. Moreover, because the 
gateway will be handling a relatively large number of 
calls per single TCP connection, the TCP (UDP) window 
size may be larger, resulting in improved throughout. In 
addition, the gateways, etc., may not have to open and 
close as many TCP (UDP) connections and fewer "keep 
alive' processes are needed. In sum, fewer processing 
resources of the gateways, etc., will be needed to proc- 
ess the calls. 

[0087] In addition, through the use of message encap- 
sulation . the invention may reduce the total header-to- 
payload ratio of the transmitted packet data. As a result, 
an embodiment constructed according to the invention 
may provide more data throughput, thereby making 
more efficient use of the available bandwidth that is pro- 
vided by the network. 

[0088] Moreover, by generating a relatively large pay- 
load for the calls, the invention makes conferencing a 
more feasible application. In many systems it is imprac- 
tical to route a large number of very small packets. To 
do so efficiently would require the routing hardware to 
have relatively small buffers. However, this is not prac- 
tical in many applications. By combining many "small 0 
packets into a single "large" packet, the invention pro- 
vides a viable solution to this problem. In particular, a 
more efficient buffer length may be used, there by re- 



ducing padding. 

[0089] The embodiments described above illustrate 
that the invention may be practiced in a wide variety of 
configurations. For example, other networking hard- 

5 ware could be used instead of the hardware described 
in the embodiments above. Routers could be used in 
place of the gateways for Packet Network connectivity. 
The functions described above may be distributed 
among the various components. 

10 [0090] Typically, the message processing operations 
including, for example, packet encapsulation, header 
assignment, identifier mapping, packet multiplexing and 
permanent hold of TCP/UDP channels would be imple- 
mented as software routines installed on and executed 

is by the corresponding hardware device. In general, the 
gateways, routers, PBXs and other related switches are 
adaptable to the software modifications that would be 
required to implement the invention. Alternatively, one 
or more of the above operations could be implemented 

20 in a hardware device, such as a microprocessor, custom 
integrated circuit or other device. These design selec- 
tions would depend on the requirements of the specific 
implementation. 

[0091] Exemplary components of those described in 

25 the embodiments above include a PBX manufactured 
by Siemens under the trade name "HICOM 300". A rout- 
er manufactured by CISCO under the tradename "CIS- 
CO 2500". An IP gateway manufactured by RAD Vision 
under the tradename "L2W-323 GATEWAY". The termi- 

30 nals (telephone, H.323 terminals, video devices, etc.) 
described above are available from a variety of vendors 
(e.g., an H.323 terminal "ARMADA ESCORT 25" by 
Vcon), any of which may be suitable provided that they 
conform to the protocol standards utilized in the partic- 

35 ular configuration. 

[0092] From the above, it may be seen that the inven- 
tion provides an effective call multiplexing scheme for 
packet networks. While certain specific embodiments of 
the invention are disclosed as typical, the invention is 

40 not limited to these particular forms, but rather is appli- 
cable broadly to all such variations as fall within the 
scope of the appended claims. To those skilled in the art 
to which the invention pertains many modifications and 
adaptations will occur. For example, various packet mul- 

45 tiplexing and demultiplexing techniques and methods of 
identifying multiplexed data may used in practicing the 
invention. A variety of formats may be used for the head- 
ers and the message structure in general. A variety of 
transport protocols may be used. A number of methods 

so can be used to encapsulate the packets, to provide call 
setup, and to perform other call handling operations. 
Similarly, various methods of call distribution could be 
employed to support multiple trunks. Thus, the specific 
structures and methods discussed in detail above are 

ss merely illustrative of a few specific embodiments of the 
invention. 
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Claims 

1. A method for routing calls over a packet network, 
comprising the steps of: 

receiving a plurality of calls from at least one 
source; 

establishing an open transport protocol chan- 
nel over a packet network protocol; and 
multiplexing said plurality of calls onto said 
open channel. 

2. A method according to claim 1 further including the 
step of associating at least one identifier with said 
calls. 

3. A method according to claim 1 wherein said open 
channel is a semi-permanent connection and/or es- 
tablished between two internet protocol switches; 
and/or 

wherein at least one of said calls is one of a 
group including: an H.323 call, a voice over internet 
protocol call, a facsimile over internet protocol call, 
a telephone call, an H.324 call or an H.320 call. 

4. A method according to claim 1 wherein said packet 
network is: 

an internet protocol network; or 
over at least one of a wireless network, a wire- 
based network and a heterogeneous mesh net- 
work; or 

over a lower level network that supports packet- 
based communications including at least one 
of an ATM network, an Ethernet-based network 
and a FDDI network; or 
over a SCN that uses a packet transport proto- 
col. 

5. A method according to claim 1 further including the 
step of encapsulating said calls within a TCP/IP 
packet or within a U DP/IP packet. 
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calls onto said open channel; and 
a transport protocol formatter for encapsulating 
said multiplexed calls within a transport proto- 
col packet. 

8. A system according to claim 7 further including an 
identifier generator for providing at least one iden- 
tifier for said calls. 

9. A system according to claim 7 wherein said open 
channel is a semi-permanent connection and/or es- 
tablished between two internet protocol switches; 
and/or 

wherein said packet network is: 

an internet protocol network; or 
over at least one of a wireless network, a 
wire-based network and a heterogeneous 
mesh network; or 

over a lower level network that supports 
packet-based communications including at 
least one of an ATM network, an Ethernet- 
based network and a FDDI network; or 
over a SCN that uses a packet transport 
protocol; and/or 

wherein said transport protocol is one of a 
group including: TCP or UDP; and/or 
wherein at least one of said calls is any of a 
group including: an H.323 call, a voice over in- 
ternet protocol call, a facsimile over internet 
protocol call, a telephone call, an H.324 call or 
an H.320 call. 

10. A system according to claim 7 wherein: 

said call manager establishes a plurality of said 
open channels; and 

said multiplexer multiplexes said calls over said 
plurality of open channels. 



6. A method according to claim 1 further including the 
steps of: 45 



establishing a plurality of said open channels; 
and 

multiplexing said calls over said plurality of 
open channels. 



so 



7. A system for routing incoming calls over a packet 
network, comprising: 

a trunk connection manager for establishing an 55 
open transport protocol channel over a packet 
network protocol; 

a multiplexer for multiplexing said incoming 
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